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cn 

y-H Abstract 

o 

CS| The article gives an overview of the parameter numerical continuation method- 

^ ology applied to setpoint control and parameter identification of nonlinear systems. 

, ^ The control problems for affine systems as well as general (nonaffine) nonlinear 

systems are considered. Online parameter identification is also presented in two 
versions: with linear and nonlinear nonconvex parameterization. Simulation results 
for illustrative examples are shown. 

u 
o 

^5 The theory of nonUnear systems is an active area of research in which exist well- 

^ tt^ estabhshed paradigms and in the same time there are many important and difficult ques- 

tions unanswered. If the problem of analysis (stability, sensitivity to parameter variations) 
^ can be resolved at a sufficient level for practical use, including by means of simulation 

(MATLAB, Ansys), the problem of controller synthesis for nonlinear systems are still "hot 
^ spot" in control theory. 

\^ It is difficult to list all of the approaches to the control of nonlinear systems, but if we 

, \ try to name at least the most famous of them, there are: 

O 

^ • Local linearization near working point and application of the linear robust control 

^ to nonlinear systems [Ij. Considering nonlinearity as uncertainty of the nonlinear 

• ^ model, the robust regulator synthesized on the basis of linearization can be used for 

^ control of nonlinear system. 

• Feedback linearization [21 131 S]. In this approach nonlinear dynamics of the initial 
system is transformed to the linear by means of nonlinear feedback. Then obtained 
linear system can be controlled with tools of the linear control theory. 

• Control on the basis of differential flatness If the states and inputs of systems 
can be parametrized via the output variables and their derivatives, such a system 
is called the differentially flat. This allows to explicitly solve the problem of the 
inversion of the system and generate the control actions. 
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• The use of control Lyapunov functions or their generahzations [6]. Synthesis of 
Lyapunov functions for the specified control can be formulated as an optimization 
problem of semi-definite programming [7J. Special method for a particular class of 
systems management is a integrator backstepping [8J. This method uses a recursive 
decomposition of the object to the subsystems of a special type, which are stabilized 
by means of Lyapunov functions. 

• Nonlinear model predictive control [9j. 

• Variable structure control, which also includes a relay and a sliding mode control 
|1U] . Promising direction is the approximation of nonlinear system by the set of 
hybrid systems and application of hybrid control jTT] . 

• Intelligent control based on neural networks or fuzzy logic. 

In this paper, we will lean on the feedback linearization approach. This method 
is attractive because it allows to implement controls for nonlinear systems as simple 
as for linear. Constructing of linearization transformation is based on the analytical 
differentiation of the system outputs and can easily be done manually or automatically 
li2j. 

From the practical point of view, a class of objects that are suitable for control by 
feedback linearization is substantially less than, for example, for the method of Lyapunov 
function or sliding mode control. The main difficulty is the mandatory requirement for 
constant order of state model equations, known as the constancy of the output relative 
degree. When relative degree is ill-defined then linearizing coordinate transformation is 
singular in some regions of phase space and the control action is discontinuous. 

Problems with the relative degree of dynamic systems arise naturally in underactuated 
mechanical systems, where the number of degrees of freedom is greater than installed 
actuators [13j. Region of phase space in which the relative degree of the system changed 
is related to the configurations in which the system changes its controllability. 

This paper provides an overview of the new approach to control of nonlinear systems, 
which combines the conceptual simplicity of feedback linearization methods and at the 
same time extends the applicability to irregular systems with ill-defined output relative 
degree. 

Approach described below is based on numerical parameter continuation methods 
for solving systems of nonlinear equations [19]. This method is based on parameterized 
combination of the original problem and some simple problem with a known solution. 
The immediate motivation for the use of parameter continuation methods in control is a 
series of papers [T^ [15], which addresses the application of these methods directly in the 
physical experiments. 

The article consists of several parts. The first part defines the basic concepts like 
models of nonlinear systems, control problems and methods. The second part is devoted 
the following objectives: output setpoint control and identification of parameters in real 
time (online). After a description of the method a simple example is given that covers a 
particular method. 

The material is based on previous papers [T6 | fTTl flS] . but all of the methods described 
below are new and not previously published. 
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1 Preliminaries 

1.1 Plant models 

In this paper we consider nonlinear MIMO systems with m inputs and m outputs in 
the state space of dimension n: 



X = f{x,u), y = h{x) (1) 

where xGXCM", yeFC M", m g f/ C M™, and maps / : x M™ ^ M", 
: M" — >■ are smooth vector fields f,h & The functions /(.) and h{.) are 

considered bounded in X. 

One important particular case of ([T]) is affine nonlinear system of form 

m 

i = fix) + ^gi{x)ui, y = h{x) (2) 
1=1 

where the functions gfj : M" — )■ M" are bounded smooth on X vector field. 
Also for the problems of adaptive control and parameter identification considered the 
following control objects with parametric uncertainty 

X = f{x,e,u), y = h{x,e) (3) 

m 

X = fix, e) + J2 9^ix, 0)ui, y = hix, 9) (4) 

i=l 

where G C M" is an unknown constant parameter which is not available for 
measuring or monitoring. 



1.2 Control problems 

In this paper we consider the following control problems for nonlinear systems of form 
Q or g): 

• Output setpoint control for the system ^ in affine form. 

• Output setpoint control for the general nonlinear system ([T]). 

• Online parameter identification of nonlinear affine (|4]) and nonaffine ^ plants. 
Let us give formal definitions of the problems considered in this paper |23] : 

Definition 1. The control problem of output setpoint tracking is to synthesize of such 
control law = uix), which asymptotically drives the system output y of system ([T]) to 
constant value y = const.' lim^^oo ?/(^) = V- In the particular case y = the control is 
called output zeroing problem. 

Without loss of generality, everywhere below we assume that y = and the objective 
of control is output zeroing. 

Definition 2. The on-line identification problem for unknown constant parameter 9 is 
to find an adaptation algorithm for estimate 9 it), which would minimize the difference 
y*it) — yit) between the measured system response y*it) to the input uit) and the response 
of model ([3| to the same input. □ 
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1.3 Linear approximation in point 

Let there be given object of control in the form of ([T| with initial conditions x(0) = Xq, 
u{0) = Uq. The task is to stabilize ([T| locally near the initial point xq G X, uq E U. 
Effective method is the linear approximation of ([T| in a small neighborhood around (xq, Uq) 
and dropping the high-order nonlinear terms of the power expansion [23j : 



X = f{x,u) ^ /(Xo,Mo) + D^{xo,Uo){x - Xq) + Du{xo, Uq){u - Uq) = Ax + Bu + 

y = h{x) ^ h{xo) + Dh{xo){x - Xo) = Cx + Ay 

(5) 

where D^f{x,u) = (^^^, Duf{x,u) = (^^^ ^ D^h{x) = 
1.4 Feedback linearization 

Definition 3. The MIMO affine nonlinear system ^ has relative degree rj for output yj 
in & C M" if at least for one function Qi is true 

c,^q-\, + (6) 

where LfX = — - — f[xj = >^ Ji[x) d -t^^e derivative of function A along a 

vector field f . 

It means that at least one input Uk influences to output yj after differentiations. 
Number r = ^™ ^ Vj is called as the total relative degree of system. If r = n and 
matrix 



A{x) 



(7) 



is full rank, then the original dynamical system Q in © equivalent to system: 



yj'^ = C]'h, + Cg^C]' ^h, ■ = B{x) + A{x) ■ u (8) 
The nonlinear feedback 



u = A{x)-^[v - B{x)\ (9) 
converts in subspace 6 original dynamical system (|2| to linear: 

?/(^^) = (10) 
1.5 Linearization of irregular systems 

Definition 4. The relative degree of affine system ^ is called ill-defined, if there are 
points x° E & in the state space, in which the decoupling matrix A{x) is rank deficient, 
i.e. 

detA(x°)=0 (11) 
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Systems with ill-defined relative degree is also called irregular. 

Irregularity does not mean that it is impossible to solve the particular control problem 
(output setpoint control or parameter identification). It just means that not all the 



trajectories of the linear system (10) to which transforms the original nonlinear system 



([2]) can be reproduced at the output y due to the nature of nonlinearities. 

Example 1. The simplest specific example is the system x = u, y = h{x) = x(x^ — 1) + 1, 
x{0) = 1 for which the problem of output zeroing y ^ is needed to solve. 

If the system under consideration was a constant relative degree, the use of control 
V = —y after feedback linearization would give the output trajectory of y{t) = exp(— t), 
which is everywhere decreasing y{t) < 0. 

In this case, the nonlinearity y = h(x) has two limit points a^i 2 = ±l/\/3; in which 
h'^[x\ 2) = 0. Any trajectory y{t), that connects y{0) = 1 with y{T) = passes sequentially 
through the points y\ = /i(3~"'^/^) and ^2 = h{—3~^^'^), and besides y2 > y\- Hence, any 
trajectory y{t) on the interval (0,ti) should decrease with time (Figure 1), on the interval 
(^1,^2) increase, and in the interval again decrease. Such a trajectory is not reproducible 
using the feedback linearization. 

1.6 Numerical continuation method 

Let it is necessary to solve system of the nonlinear equations 

m = (12) 

where : — > is vector-valued smooth nonlinear function. 

Lets Q C M"* is open set and C{Q) is set of continuous maps from its closure Q to M*". 
Functions Fq, Fi G (7(0) are homotopic (homotopy equivalent) if there exists a continuous 
mapping 

H ■.Qx[0,l]^R"' (13) 

that H{^,0) = Fo(0 and H{^, 1) = Fi(0 for all ^ G 0. It can be shown that the 
equation H{C,, A) = has solution (^, A) for all A G [0, 1]. The objective of all numerical 
continuation methods is tracing of implicitly defined function H{C,, A) = for A G [0, 1]. 

Lets H : V ^ is C^-continuous function on an open set T) C ]R™+^, and the 
Jacobian matrix DH{C,, A) is full-rank rank DH{^, X) = m for all (^, A) G P. Then, for all 

A) G P exists a unique vector r G IR™^^ such as 

M(e, A) ■ r = 0, ||r||2 = 1, det > 0, (14) 

and mapping 

^ : P ^M'"+\ ^ : (^,A) ^ r (15) 

is locally Lipschitz on V. 



Function (|15|) specifies the autonomous differential equation 

= ^(e,A), m=^o, A(0) = (16) 



dt [x 
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which has a unique solution ^(t), X{t) according to a theorem of solution existence for 
the Cauchy problem. 

It can be shown [9j that integral curve 7(t) = (^(t),A(t)) reaches the solution point 
(^*, 1) where 0(^*) = in finite time t < oc. 

1.7 Control of the output as a two-step problem 



The following fact is important for the methods discussed in subsections 2.1 and 2.3 
Let there is a system of the form ([T|. Required to solve the output setpoint control 
problem y ^ y. Let x = h~^{y). Then the problem can be divided into two phases: 

• Implementation of movement along the trajectory starting at x(0) = Xq and 
ending in x{T) = Xe, where Xe G e{x) is point in the neighborhood of x, T < oo. 

• asymptotic stabilization ([T]) near the point x for t > T with initial conditions x{T) = 
Xe . 



The main result of the methods in sections 2.1 and 2.3 is explicitly regard to task 1. 



The last task 2 may be solved by the linearization at x according to section 1.3 



2 Main result 

2.1 Regularization of afRne nonlinear system by parameter con- 
tinuation 

Let's associate with the plant ^ linear dynamics system with m inputs u, n states z, 
m outputs T] and with the same relative degries for outputs such as in ^ 

z = Az + Bu, 1] = Cz, -^j^V = Ui. (17) 
Now we want to mix output of ^ with output of (17) 

H={l-\)-ri + \-y (18) 

where A G [0, 1] is a continuous time-dependant parameter, value of which determines 
the relative contribution of the outputs rj and y to H. 

Control process can be represented as follows. At time t = parameter value is A = 0, 



which corresponds to control of only a linear system (17). After, the value of A starts 
increasing, but in general, it is described by some bounded function X{t). The parameter 
A reaches A = 1 in a finite time t = T < X, which corresponds to the end of the process 
control. 



By definition of the output relative degree, each component Hi in (18) should be 
differentiated times with respect to t until it becomes an explicit function of any input 
u. We obtain after differentiation: 
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k=l 



k=l 



(19) 



k=l 



where are the binomial coefficients. 
Let's denote following 



A, = (A,A,A,..,A(^'-i)) 
A,i{x,z,k,) = [XCg^Cf'hif + (1 - A) ■ 4 



(20) 



Si(x,z, Ai) 



k=l k=l 

where Sk is a vector of dimension m, all of whose components are equal to except 
the k-th. 

With introduction of notation from (20) the equation (19) can be written more com- 
pactly: 

= A^,i{x, z,A)-u + Ai,2{x, z) ■ A^"') + i3,(x, z, A), (21) 

Considering all of the components Hi after differentiation according to the relative 
degrees of outputs it is possible to write an algebraic condition (21 ) in the matrix form: 



i/M = Ax{x, 2, A) ■ M + A(x, z) ■ A^""""-) + i3(x, z, A) 

= ^{^^ A) ■ + B{x, z, A) ^^^^ 

where = max{r,}, A = (A, A, A, A^'^— "D), i/M = (i/^\ ...i/i^'"^ . 

Now we ready to formulate following theorem, which is our main constructive result 

Theorem 1. Suppose 

rank^(a;, 2;, A) = m, (23) 
then for state feedback with hounded new input v 

XiL.^ = a-r(^)+^>-S), (24) 
where vector t{A) calculated to satisfy following constraints 

^. r = 0, ||r||2 = 1, det ( ) > (25) 



r 

and a = const G M+, z{0) = 0, A(0) = following can be stated. 
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0. There exists smooth control trajectory {u{t),X{t)) generated by (24) which leaves 
point (m(0), 0). 



1. System (22) transformed by feedback (24) to linear controllable form 

H^"^^ = V (26) 

2. Curve {u(t), \ (t)) either passes through point X = 1 or diffeomorphic to a circle. 

Proof Full proof is omitted. Assertion is proved by explicit expression of vector t{A) 



for t = 0. Proposition 1 is trivial by substituting (24) into (22). Statement 2 is argued as 



analogous statement for the solution curve in parameter continuation method for nonlinear 
equations 



Remark 1. As a result of feedback (24) system with the output (18) is transformed into 



a linear (26), which can be controlled by any known methods of linear control theory 
(pole placement, linear quadratic regulator, etc.). Outer linear feedback is crucial for the 
practical applications of the proposed approach, as it allows to compensate uncertainties 
in the model and implement robust control systems. 

Remark 2. The last theorem indicates that the parameter a is additional degree of freedom 
in the controller design. The larger this constant, the faster the solution arrives to the 
A = 1, but numerical integration becomes more stiff. 

With a decrease of the parameter a to less than a certain critical value amin conver- 
gence of parameter A to the value of A(t) — ?■ A* < 1 is observed, which is unacceptable. 
Accurate characterization of this phenomenon, as well as assessment of amm, is the subject 
of further research. 

Remark 3. In some cases, it is desirable to vary the speed of convergence A(t) to the 
final value of the parameter X{t) — > A* = 1 for the regulation of transient time. Let us 
introduce the scalar coefficient 7 > 0, with which possible to control speed of change A(t). 
If 7 > 1 then X{t) reaches a value of A* = 1 faster than compared to (24). Otherwise, 
when 7 < 1 transition process is slowing down. 



We modify the (24) as follows 



u 



a--fT{A) + Q{A-Qy{v-B), 



(27) 



where Q = 
is equal to 7. 



diag{l, ...1,7) is square diagonal matrix, the last diagonal element of which 



Equation (27) obtained from (24) by scaling vector r and application of weighted by 



matrix Q pseudoinverse of A. 

Remark 4. Attention is required in case > 1 for the relative degree of the output H. 
Fulfillment of condition H^^^ = when > 1, in general, does not consequent to H = 0. 
For example, if H{t) = for a time interval t G [0, T], but if initially H{0) = Hq 0, then 
for the whole time interval is obtained H{t) = Hq and H{t) = Hq ■ t 0. 

In the case of SISO system with the choice of initial conditions for the A*'*-'(0) is possible 
to achieve H^'\0) = 0. For MIMO systems with > 1 the selection of A*^*''(0) in general 
can only minimize Hence, necessary to use of an external linear feedback to control 

the if to in case of r,- > 1. 
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Remark 5. Condition (23) is a standard assumption of using parameter continuation 
method, which corresponds to the possible existence of hmit points of trajectories {u{t), X{t)) 
at which Ai ^ im^2, and the absence of bifurcation points. At the same time in some 
regions of phase space X x Z may be a situation where TaiikAi{x,z,A) < m, in that 



case, the system with output (18) cannot be directly linearized by the feedback, but the 



proposed method is still applicable. 



Remark 6. Condition (23) can be relaxed a little, but we do not consider this here. In fact, 
the proposed method allows the existence of the phase space of simple bifurcation points 
where dimker^ = 2. When the control trajectory passes through a simple bifurcation 
point the sign of vector r flipped (a more detailed analysis in [9j). 

Overcoming the bifurcation points, in which is observed Ai G im^2, also possible 
within the known approaches for the numerical parameter continuation (e.g., using the 
Lyapunov-Schmidt decomposition j9]). 

2.2 Illustrative example of afRne irregular system control 

Consider following abstract example of MIMO system, that changes its relative degree 
in the state space 

Xi = Ui + x\ 

yi = x^- xi + 1 

y2 = X2C0S(2X2) 

with initial conditions a;(0) = (1, 1)-'". We need to solve the problem of output zeroing 
Differentiating the outputs, we obtain 

yi = {3x1 - l) ■ (^1 + ^l) = (^nui + h ^^^^ 
y2 = (4^2 cos(2x2) - 2^2 sin(2x2)) • {u2 + xl) = 022^2 + ^2 

Obviously, the system in interval x G [0, 1]^ can not be completely linearized by the 
feedback, because there are exists such x* that aii(x*) = or 022(2^*) = 0. 



Let's associate with (2.2) linear system of a form 



Vi = «i> ^2 = U2 (30) 
with initial conditions ri{0) = (0, 0)"^ 



According to the equation (19) we obtain for H = the following 



= ' ("0' al) + (1 - ^)^- -4. = !/-.). B = A (ij) (31) 

To test the robustness of the controller to the system output y was applied additive 
perturbation of the form Ay = (1, sin(20t))"^. External control circuit is implemented 
using a P-controller with a gain of 100. The value of a is chosen as a = 20. 

The model in Simulink to control the system shown in figure 1. Modeling results are 
shown on figures 2-4. 
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Figure 1. Simulink model. 
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Figure 2. Output response. 
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0.05 0.1 0.1 5 0.2 0.25 0.3 0.35 0.^ 

Figure 4. Dynamics of parameter A. 



2.3 Control of nonafRne systems 

Formally, the nonafiine systems of the form ([T]) can be transformed to affine form by 
adding integrator to inputs: 

Xu = u (32) 
y = h{x) 

As the result there is a new state vector (x, x„) and the relative degree of each output 
is increased by one. Consider another way for the case when the increase of the relative 
degree is undesirable. 
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Let there be given nonlinear system of the general form ([T|, for which it is necessary 
to solve a problem of output zeroing ?/ — )■ 0. Denoting yo = h{xo), it is possible to write 



the following modification of (18): 



H = y + yo\-yo = 



(33) 



Feature of (33) in comparison with (18) is absence of need for system (17) and linearity 



of H in the variables y and A. Note that the material of section 2.1 can also be implemented 



for the function of form (33) instead of (18). 



The next step of approach is the linear approximation of function f(x,u) for variable 
u around point Ui 



where 



X = f{x, u) ^ /(x, Ui) + D^f{x, Ui){u - Ui) = f\x) + g\x)u 

f\x) = f{x, Ui) - D^f{x, Ui) ■ Ui 
g\x) = D^f{x,Ui) 



(34) 



(35) 



Ui. 



Thus, the system ([T| approximated by the affine system in the neighborhood of 
System behavior of ([T]) in a whole space U can be approximated by the bundle of systems 
(34), each of which is a linear approximation of for a particular Ui G U. 



Since (34) is the affine system, the concept of relative degree output can be applied. 
Differentiating each component Hj according to its relative degree rj, can be obtained 
using ([8| the following 



(36) 



Denoting 



k=l 



(37) 



^^{x)=qj^, 

equation (36) can be rewritten in compact form 



i/j^^) = b;.(x) + Ai^^.(x) ■ u + A*2_^. ■ A("^) 



(3J 



Considering all components of Hj, it is possible to write (36 ) in matrix form by analogy 



with (22): 



i/M = Ai(a;) ■ u + ■ A^"^™-) + B^(a;, A) 



A'(x) ■ 



u 



+ B'(x,A) 



(39) 



where Tmax = max{ri}, A = (A, A, A, A^''™"- ^)). 

The following theorem provides a theoretical basis for the possibility of parameter 



continuation application to control the bundle of systems in form of (34) 



12 



Theorem 2. Suppose that for some moment of time ti defined Xi, Ui and Aj and for 
moment of time ti+i = ti + At quantities Xj+i, Mj+i and Aj+i are given, satisfying the 
equations (33) and ([T|, i.e. 



H = h{xi) + Ai ■ ?/o - Z/o = 
H = h{xi+i) + Aj+i ■ ?/o - 2/0 = 



with 



Aj+i — Aj + AAj 
Xj-j-i ~1~ Axi 
then Axi and AAj are infinitesimals of the same order. 



(40) 



(41) 



Proof Full proof is omitted due to simplicity. The theorem is proved as follows: nonlinear 



function h in last equation (40) expanded in power series around Xj and Aj. From the 

I Ax, 



expansion A lambdui and Axj are expressed. Next limit of the ratio AAj 
AAj — )■ is composed and its boundedness is shown. 



for 



The theorem [2] provides an important theoretical conclusion: a small change in pa- 
rameter A leads to a small change in the x satisfying (33). Hence, after a small change 



of A the control action u, which must be applied to the input of the plant ([T]), can be 
obtained from the linearization of the system around the previous value of A. 
Control method can be described as follows: 

0. A = 0, Ui := Uq, where Uq is solution of /(xo,Mo) = 0. 

1. Obtain linearization (34) at point Ui as functions /* and g\ 



2. During time interval At apply the feedback in form (24) for system with outputs 



(39) 



u 

^ ('/^ max ) 



a ■ r(A) + (A*)+ ■ [v - B' 



(42) 



where vector t(A) calculated in such a way to satisfy the equations (25) for matrix A* 
and external v control input for linear system H^'^^ = v stabilization. 

3. Update the variable Ui := u, go to point 1 of algorithm. If A > 1 then exit. 



2.4 An illustrative example of nonafRne nonlinear system control 

Considered an abstract system with one input and one output form 



X = u^(x^ + 11 



y = x(x — Ij + 1 

with initial state x(0) = 1. Necessary to stabilize the system with output zeroing 
y->0. 



Let's write down the output function (33) of system (43) 



H 



y + yoX- yo 
xix^ - 1) + A 



(44) 



Next transform the system (43) to affine form (34) by linear approximation of the first 
equation at point Ui. 
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y = — 1) + 1 
g\x) = 3m^(x2 + 1) -e""' 



uUx^ + l) + e 



(45) 



Differentiating (44), it is possible to write the equations (36) and (39) for the considered 
example 



H 



dh 

dx 

^\x) 



9'{x) yo 



(46) 



B\x) 



where ^— = 3x^ — 1 
ox 

Matrices A* and B* from (46) are used in the feedback (42) of control system. Outer 



control loop is implemented as a proportional controller with a coefficient of 10. The value 
of a is chosen a = 2. 



Model of the control in the MATLAB/Simulink environment (43) is shown at Figure 
5. The simulation results are presented in Figures 6-8. 
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Figure 5. Model of closed-loop system in Simulink. 
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Figure 8. Dynamics of parameter A. 



1.5 



2.5 



Identification of parameters for system with linear parame- 
terized uncertainty 



In this section, the ideas presented in the part 2A^, extended to the problem of pa- 
rameter identification of nonlinear systems in real time. The purpose of identification 
is to minimize the difference x — x, where x is an output of the process with unknown 
parameters, and x the output of process model. To solve this problem we introduce a new 
function H and the way to avoid the digital differentiation of x is considered. 

Let the following nonlinear system in which uncertainties are parametrized linearly by 
a vector 6 is given 



X 



(47) 



/(x, u) + w{x, u) 

where vector G C M"^ is quasi-constant unknown parameter which should be 
identified in the process of adaptation, w : M" x — )• M'^ x is the know vector 
function. State x considered available for measurement or observation. 



For system (47) model is known, which uses a parameter estimate 9 instead of true 



unknown value 9: 



X = f{x, u) + w{x, u) ■ 9 



(48) 



with initial conditions £(0) = xq. Next, it is assumed that xq^ xq. 
The problem is to find such a value of parameter 9, which would minimize the difference 
X — a; — 7- 0. 



By analogy with (33) associate for the systems (47) and (48) following function, which 
takes into account that the final goal of regulation by 9 is zeroing the difference x — x. 



H = X — X 



A)(xo - xo) 



(49) 



Differentiating (49), obtain 
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H = X — X + A(xo — xq) 



(50) 



equation (50) can be written using the notation of Ip9\) for matrices A and B 



where 



H = X — f{x, u) — w{x, u) ■ 9 + A(xo — xq) 
= Ai-e + A2-X + B 



Ai = —w{x, u) 

A2 = Xq — Xq 

B = X — f{x, u) 



(51) 



(52) 



Then to (51 ) it is possible to apply approach of solution continuation for the equation 



if = by analogy with (24) and (42). Hence we obtain the control 9{t) and dynamics of 
parameters \{t) 



a ■ t{A) + A+ ■ {-kH - B) 



(53) 



where vector t[A) calculated in such way as to satisfy the equations (25) for A, and 
A; > is the proportional loop gain. 

A separate task is to calculate x, since the variable x it is result of measurement at 
which there will be noise and which numerical differentiation is undesirable. 



Let's rewrite the last equation in (53) 



= a ■ r{A) + ^+ ■ {-kH - B) 

= a ■ t{A) - kA+H - A+B 

= a ■ t{A) - kA^H + ^+/(x, u) - 

Next, we consider the matrix Ai(t) = a- t{A) — kA'^H + A^ f{x, u) and M{t) 
then let's split them so that it was possible to write 



(54) 



a-T - kA^H + A'^f{x, u) - A'^x 

M+Afx (55) 



M2J ^ \Af2 

Let's integrate A = A^2 + A/2X to obtain the dynamics X{t). Applying integration by 
parts to the last term of N'2X, it is possible to write the following equation 

A(t) = [ M2{T)dT + J\f2{t) ■ x(t) - J\f2{Q) ■ x(0) - / M(r) ■ x{T)dT (56) 
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The equation (56) determines the dynamics of parameter X(t) without direct differ- 



entiation of X. Unfortunately, a similar equation from (55) for 6{t) can not be obtained 
analytically. 



Because Af2 calculated on the basis of function w{x,u) from the process model (48) 
and it does not contain noise, the digital differentiation of A/2 for calculating A'2 applicable 
in this case. 



To calculate the 9 consider a model (48 ) with outputs (49 ) for the purpose of regulation 



if — 7- 0. Let's perform feedback linearization of system (48) as follows 



[w{x,u)]'^{ve - f{x,u)) 



(57) 



that transforms of nonlinear system (48) to linear x = Vq. Further, using proportional 



control Vq = —kg ■ H, ke > 0, it is possible to solve the problem of regulating H to 0. 



Hence we finally obtain from (57) dynamics of 6 



Note that the proportional control vq 
component to improve the accuracy. 



d=[w{x,u)] + {-ke-H - f{x,u)) (58) 
-kg-H can be complemented with an integral 



Also, it should be noted that, since in the (58) the matrix pseudo-inverse of w{x, u) is 



calculated, which can be degenerate for some pairs (x,u), the trajectory 6{t), in general, 
is discontinuous. But as in the output equation ( [49] ) regularizing term introduced (1 — 
A)(a;o — Xq), it can be expected that the trajectory 6 asymptotically approaches the 6. 



2.6 Illustrative example of identification for linearly parametrized 
system 

The abstract system with one input and one output is considered 

x = {l-x^)e + u (59) 

with the value ^ = 5 of the parameter to be identified and initial state x(0) = Xq = 0. 

The control action is linearly increasing signal u{t) = t. 

For the model of the process we will use the following system 



i = (1 -x'^)§J^u 

with initial state x(0) = Xq = 0.5. 



(60) 



Let's write the function (49) for a system output (59) 



H = x — X — {1 — X){xo — xo) 



(61) 



Having differentiated (61), it is possible to write the equations (51) for this system 



H = X + {x — 1) ■ 9 — u + A(xo — Xq) 
= Ai-e + A2-X + B 



(62) 



where Ai = x"^ — 1, A2 = xq — xq, and B = x — u. 

Using the notation from (55) equation (56) acquires the following form: 
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M{t) = a ■ T + [x"^ - 1 xo-xo)^ {-kH + u) = (^^^ 
Ar(t) = - - 1 xo-xoy=(^^^ 
X{t)= [ M2{r)dr + M^it) ■ x{t) - Ar2{0) ■ x{0) - [ ^(r) • a:(r)dr 



(63) 



The dynamics of parameter 6, in this case according to (58) 



e = (1 ■ {-kg -H-u) 

where (a)+ = a^^ for a 7^ 0, and (a)+ = for a = 0. 



(64) 



Model of the control for (59) in the Simulink environment is shown at Figure 9. The 



model consists of several subsystems: 



- "Plant" is the plant (59) itself, 



"Plant [model] & Theta" is the model of plant (60) and calculation of parameter 9 



dynamics by (64) 



- "Lambda calculation" is the block for calculation of A by (63), 

- "Parameter continuation" block for calculation of matrices M. and M . 
Feedback constants are chosen as follows: a = 2.5, k = 5, kg = 10. To model the 

stability of adaptation to measurement noise of state x source of uniformly distributed 
noise in the range [—0.01,0.01] is added. Parameter 6 limited in range of [0, 10]. 
The simulation results are presented in Figures 9-12. 
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Figure 9. Model of the system in Simulink. 
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1 2 3^56 

Figure 10. Dynamics of the identified parameter 6{t). 




12 3^56 

Figure 11. Dynamics of the identification error x — x. 



20 




Figure 12. Dynamics of parameter A. 



2.7 Identification for the case of nonlinear ly parametrized uncer- 
tainties 

In this section we consider the problem of system identification with nonhnear parametriza- 
tion of uncertainty. A new interpretation of the parameter identification problem other 
than provided in section 2.5 is given. 



Let the following nonlinear system which uncertainties that are parametrized by a 
vector 9 is given 



X = f{x,u,9) 



(65) 



with initial conditions a;(0) = Xq, known input signal u{t) and with the measurable 
state X. 



For the system (65) the model is known, which uses a parameter estimate 9 instead 
of the true value 9: 



X = f{x,u,9) 



(66) 



The problem of the method described in 2.5, is that to zero identification error x 



X 



the controllability of state x by parameter 9 is required in system (66 ). In fact, adaptation 



algorithm can be restated as the tracking problem for (66) and input 9 with objective 
X — )■ X. 

Nevertheless, even if system with an output x is not completely controlled by 9 it is 
possible to solve the problem of parameter identification. The following simple idea is for 
this purpose offered: periodically in the discrete timepoints tj restart integration of model 
(66), and for the initial state take the state of identified plant x{ti) := x{ti). This idea 
has its roots in the method of nonlinear model predictive control. Hence we conclude that 
during the time interval t G [tj,tj+i) the state x{t) can be expressed by integral: 
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X{t)= f f{x{T),u{T),9)dT 

Ju (67) 
x(ti) = x{ti) 



Thus, at the time tj+i before the next restart of the integration of (66) it is possible 
to define the following error signal 

e{6,ti) = / f{x{T),u{T),0)dT - x(ti+i) 

\. (68) 
f{x{r),u{r\0)- f{x{r),u{r),0)dr 

Function e(^, tj) defined in discrete moments of time ti and is subject to the minimiza- 
tion e{6, U) — > for U — )• oo. 



Consider the continuous version of (68) in order to understand the properties of the 
minimization problem for e{6,ti). In the limit tj — tj+i, it is possible to write an identi- 
fication error as 

e{6,U) ^ e{9,t) = f{x{t),u{t),9) - fix{t),uit),9) (69) 

Should be noted a few features of the problem for solution of equation e{6,t) = 0: 

- this problem is time-dependent (nonstationary), i.e. in general e{6,ti) ^ e{6,t2) for 

- the position of the solution point 6 is stationary, i.e. for = following e{6, t) = 
is true for all t. 

The task of zeroing e{6,t) — )■ can be solved by a known method based on feedback 
linearization (Newton's method). Differentiating e{6,t) it is possible to obtain 

de ^ de 

e = —.-e + — 

If J. 

df 

Assuming that rank — - = n, it is possible to define the following dynamics of the 

d9 

parameter estimation 6: 



V 
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(71) 



where > is a feedback gain. 



Substituting (71) in to (70) we obtain the linearized dynamics 

de 



"^■"+9t (72) 
-k-e + A 
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Theorem 3. // 



df 

rank — - = n (73) 

de 

and 

|Ai| < oo (74) 



it is always possible to choose a vector k > in (71) , that neighborhood of a point 9 = 9 



is globally asymptotically stable and convergence e — e can be achieved for all initial 9(0). 

Proof Outline of the proof can be described as follows. Because each component of the 
vector A = de/dt is limited it is always possible to choose constant A; > in such way 
that in some area O perturbation A does not affect the convergence of e. Further analysis 
is carried out in complement O of the set O, which can be regarded as a neighborhood 
oi 9 = 9. Expanding e in the neighborhood of 9 it can be shown that ^ = ^ is a locally 
stable. 

2.8 Numerical continuation for the identification of nonlinear pa- 
rameterized uncertainties 



Described in (2.7) is the basis and the main idea of the method of identification. 
However, before formulation a practical adaptation algorithm with numerical parameter 
continuation we must develop the following aspects: 



discretization of adaptation law ( [7l| for using the error signal e{9,ti) from (68) 
computation of a partial derivative de/d9 for discrete case, 



- relaxing the rank condition (73), ie actual application of the parameter continuation 
methodology. 

Denote the partial derivative de/d9 of function e{9,ti), calculated at time ti 

D,e{9,t.) = ^-^ (75) 
o9 



From (68) it is possible to write 

D^e{9, U) = ^ [ f{x{T), u{T),9)dr - a:(ti+i) 

-^f{x{T),u{T),9)dT 

u o9 

where the last integral is element-wise integration of the Jacobian matrix /. 

The algorithm of the regulator is represented further continuously in time, discretiza- 
tion of signals is considered only for de/d9 and e, which are converted to continuous with 
zero-order hold transformation. 



Hence (71) can be written at time interval [tj,tj+i) 
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-k[j'"' ^.f{x{r),u{r),9)dr^ ■ (77) 

ti + l 

f{x{T),u{T), 9)dT - 

Let's consider the remained subtask, namely application of parameter continuation 



strategy to the problem of adaptive identification in a case when the rank condition ( 73 ) 
isn't satisfied. As mentioned above, the identification problem is reduced to a nonlinear 
equation e(^, tj) = with disturbances. Therefore, the material of the theorem [l] can be 

directly applied to the system y = e{9,ti), 9 = u, B = and = 1, and considering 



regulation of the convergence rate using (27). 
Let's construct the homotopy mapping 

H = X-e + {l-X)-{9-9o) (78) 
Further it is possible write the matrix A 

A= (^XDi^e{9,ti) + {l-X)E e{9,t.i) - 9 + 9^ (79) 

where E is unit diagonal matrix. 



Finally, we obtain the dynamics of the solutions as a special case of (27) 
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a --I- t{A) - kQ{A ■ Q^H, (80) 



where coefficient a > determines the priority of change A, coefficient 7 > controls 
the rate of convergence and A; > is a proportional feedback gain, Q = diag{l, ...1,7) is 
square diagonal matrix, the last diagonal element of which is equal to 7. 

2.9 Illustrative example for the system identification with non- 
linear parametrization 

For example, consider the following nonlinear oscillation system 

X2 = —OJ sm^b'xij + u 

performs forced oscillations under the action of disturbance u{t) = sin(4t). Initial 
conditions are given x{0) = (0,0)^. 

The identified parameter is ^ = 0.75. Frequency value u is known for controller: 
u = 2. 

Consider two solutions: 

- abstract solution under the assumption that information of the derivatives f{x{t),u{t), 
is available, 

- complete solution using only observable states and signals Dge{9,ti), e{9,ti). 
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The first solution, discussed below, is only illustrative and can not be implemented 
because the signal x (ie. f{x{t),u{t), 9)) in practice is not available for the measurement. 
However, this problem can be solved directly without time discretization. 



Let's associate with (81) model of the form 



Xi = X2 

X2 = —oj^ sin(^xi) + u 



(82) 



with the same as for (81) initial conditions a;(0) = (0,0)"^. 

Parameter identification implemented as parameter continuation for zeroing the error 
signal e{6,t), which is considered as stationary function from 6 with perturbations. 

Block diagram of the model in MATL AB/Simulink is shown in Figure 13. The model 
consists of the following subsystems: 



"Plant" is an identified system with unknown parameter 9 modeled by (81) 



- "Plant Model" is model of identified object for computation of x via (82), 

- "Derivative calc" is subsystem for computation of ffx2/d6, 

- "Feedback linearization & continuation" is embedded MATLAB function, that im- 



plements the parameter continuation dynamics (80). 

Note that in the continuous case, while minimizing the difference of derivatives e{6, t) 
in (82) used x := x. 

For the parameters of the matrix A used in (80) is selected: 7 = 0.1, = 10, a = 1. 



The simulation results are presented in Figures 14-16. 
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Figure 13. The model in Simulink. 
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From the obtained data it is evident that the algorithm converges to the desired exact 
value ^ = 0.75 of estimated parameter. 

The second solution, which uses only the signals Dge{6,ti) and e{6,ti) based on the 



method described in section 2^ and is a primary interest for the implementation. 

Block diagram of the model in M ATL AB/Simulink is shown in Figure 13. The model 
consists of the following subsystems: 



"Plant" is an identified system with unknown parameter 9 modeled by (81) 



"Plant Model" is model of identified object for computation of e{6,ti) via (68) 
"Derivative calc" is subsystem for computation of Dge{9,ti) by (76), 



"Feedback linearization & continuation" is embedded MATLAB function, that im- 



plements the parameter continuation dynamics (80). 
Sampling time At = — tj is selected 0.1 sec. 

The subsystem "Plant Model" implement integration of (82) and periodic updating 
of the initial state x{ti) = x{ti) after an interval At, thus realizing the equation (68). 



Subsystem "Derivative calc" calculates the integral of the partial derivative 8x2/86x1 



Dge{9,ti 



cos(9 ■ xi) ■ Xidr 



(83) 



For the parameters of the matrix A used in (80) is selected: 7 = 0.05, k = 10, a = 0.5. 



The simulation results are presented in Figures 18-20. 



27 




M- 

Pulse 



I 



Plant Model 




lnteBrat«_lamb{ a 



In SiH 



Sample 
and hkild [el 



Samiple 
and Hold [de_dtheta] 



3cQpE_lambda 



■:5_dthieta 

^.lambda 



Integrate 



pEEdbats linEarization 
& EzontinuaiiDn 



Figure 17. The model in Simulink. 
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Figure 18. Dynamics of the identified parameter 9{t). 
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Figure 19. The state X2 of identified plant and model X2. 
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Figure 20. Dynamics of parameter A(t). 

From the obtained data it is evident that the algorithm converges to the desired 
value of the estimated parameter Q = 0.75. The dynamics of X{t) not experiencing the 
bifurcation bends which is caused by discretization of model. 

2.10 Adaptive control 

In this section we only point out that on-line parameter identification is central to a 
particular type of adaptive control - Model Identification Adaptive Controller (MIAC) 
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The aim of adaptive control with reference model (model reference adaptive control, 
MRAC) is to achieve closed-loop behavior prescribed by dedicated model. In the case 
of MIAC type control the continuous adjustment of the model parameters is performed 
to minimize error between the model and the plant. So there is no need for a reference 
model describing the desired characteristics of a closed-loop. 
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Figure 21. Adaptive control structure with the identification of parameters (from 



Thus, both at a output regulation stage and at a stage of parameter identification the 
application of parameter continuation methodology as a part of the adaptive regulator is 
possible. 



Conclusion 

A survey is given of the parameter continuation method used for the control and 
parameter identification of nonlinear systems. Development of the computational basis 
for the implementation of nonlinear systems allow to consider more sophisticated regula- 
tor algorithms that can handle more difficult to control systems (in particular, failed to 
feedback linearization) . 

Without claiming to cover all of the possible applications of parameter continuation 
methods in the paper following control problems have been considered: 

- output setpoint control for the affine nonlinear systems, 

- output setpoint control for the nonaffine nonlinear systems in general form, 

- online parameter identification of nonlinear affine systems, 

- online parameter identification of nonlinear nonaffine plants. 
Further work will be carried out in two directions: 

1. First, the practical meaning of the proposed methods has yet to be confirmed by 
the application of this algorithm to real existing systems, the control of which was difficult 
before. In our view the application to systems with multiple equilibrium states between 
which the phase transition occurs \21\ is quite promising. 

2. As part of the general methodology of parameter continuation, namely param- 
eterized transition from simple to complex problems, the offered methods shall receive 
more abstract theoretical basis. Promising fields of application is category theory and 
categorical homotopy theory to the formulation of the proposed algorithms and related 
phenomenons in the control theory [22j. 

In conclusion, it should be added that all Simulink models considered as illustrations 



for this paper can be downloaded here https : //sites . google . com/site/akpc806a/ 
IParam eterC ontinuationFiles . rarl 
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